منابع مشابه
Information capacity of the Hopfield model
The information capacity of general forms of memory is formalized. The number of bits of information that can be stored in the Hopfield model of associative memory is estimated. It is found that the asymptotic information capacity of a Hopfield network of N neurons is of the order N3 b. The number of arbitrary state vectors that can be made stable in a Hopfield network of N neurons is proved to...
متن کاملCapacity of the Hopfield model
For a given 0 < δ < 2 if [Nδ] neurons deviating from the memorized patterns are allowed, we constructively show that if and only if α(δ) := p(N)/N = (1 − 2δ)2/(1 − δ)2 all stored patterns are fixed points of the Hopfield model. If [NδN ] neurons are allowed with δN → 0 then αN = (1−2δN )2/(8−1(1−δN ))2 → 0 where 8 is the distribution function of the normal distribution. The result obtained by A...
متن کاملProbabilistic Information Capacity of Hopfield Associative Memory
T his pap er defines a form al pr obabilist ic notion for the information capac ity of the Hopfield neur al network model of associat ive memory. A mathematical express ion is derived for the number of random binary pat terns that can be stored as stable states in a Hopfield model of memory with n neur ons with a given probab ility. The derivati on is based on a new approach using two powerfu l...
متن کاملOn the Maximum Storage Capacity of the Hopfield Model
Recurrent neural networks (RNN) have traditionally been of great interest for their capacity to store memories. In past years, several works have been devoted to determine the maximum storage capacity of RNN, especially for the case of the Hopfield network, the most popular kind of RNN. Analyzing the thermodynamic limit of the statistical properties of the Hamiltonian corresponding to the Hopfi...
متن کاملOn the Critical Capacity of the Hopfield Model
We estimate the critical capacity of the zero-temperature Hopfield model by using a novel and rigorous method. The probability of having a stable fixed point is one when α ≤ 0.113 for a large number of neurons. This result is an advance on all rigorous results in the literature and the relationship between the capacity α and retrieval errors obtained here for small α coincides with replica calc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 1985
ISSN: 0018-9448
DOI: 10.1109/tit.1985.1057069